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Inis tinal report m the faculty Perception ct 
Students series is concerned with the examination ot college students 
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feint average, cumulative grade point average, ct,d l a nk- in-class, 
were t-sted ter relation snip against criteria dr* vii: tror.i trequency ot 
being known tc members ot the lacuity and now i nation fcy lacuity tc 
several laudatory categories (these latter recorded on Student 
Nc lunation ioim, see TM OUO 181 tclow) . The- major coin p one n t ci 
general cclaiz was revealed tc be academic p-erl or mauce, although 
technical ditticultios (size c: sample, limited reliability ot other 

ciite iicn iiitdsi;rc-s) may nave dampened other potential i Hidings. 
Inter-iater reliability and th* eiiect cl emitted it°&s on tn< 

Stuient Eating Form are analysed. The paper concludes with c 
discussion ct some ct the problems encountered in the study and 
speculations regarding the i n pi i cat ions tor rurther research. Set 
also TA 0 00 174 arid T ft 000 170- 179. (TG) 




ED 05 0 1 31 



o 

00 



o 

o 

o 

r : 

Fh 

o 

ERLC 

iifflinaffaHaaaa 



FACULTY PERCFFTlOi^ OF STUDENTS 

VI. Characteristics of Students for Whom 

There Is Faculty Agreei&eir; on Desirability 



JUNIUS A. DAVIS, Developmental Research Division, ETS 



U S OliF ART ME N 1 OF HEALTH. EDUCATION 
& WELFARE 

OFFICE OF EOUCATION 
THiS DOCUMENT HAS BEEN REPRODUCED 
E X ACT! V AS RECEIVED FROM THE PERSON OR 
organization Originating it points cf 
VIEW Cft OPINIONS STATED DO N0» NECES 
SArllLV REPRESENT Of FlClAl OFFICE OF EDU 
CAIiON POSITION OR POLICY 



Research Bulletin 



RB-66-28 



June 39^6 



EDUCATIONAL TESTING SERVICE 
Princeton, Nev Jersey 



1 



FACULTY PERCEPTIONS OF STUDENTS: 

VI. Characteristics of Students for Whom 
There Is Faculty Agreement on Desirability 

Abstract 

This final report in the Faculty Perceptions of Students series has con- 
cerned, in the main, examination of students defined by a consensus of faculty 
as desirable. A variety of measures were tested for relationship against 
criteria drawn from frequency of being known and nomination by faculty to 
several laudatory categories. The major component of general acclaim was 
revealed to be academic performance, although technical difficulties (size of 
sample, limited reliability of other criterion measures) may have dampened 
other potential findings. 
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FACULTY PERCEPTIONS OF STUDENTS 



VI. Characteristics of Students for Whom There Is 
Faculty Agreement on Desirability 

Purpose 

Previous reports in this series (Davis, 1964b; Davis, I964d) were concerned 
with faculty definition of desirable student traits* In those analyses, 
faculty rated students in terms cf general desirability and cn a number of 
other traits; the analyses involved, essentially, the determination of re- 
liable variance in th' 1 ratings of other traits which might be associated with 
a parallel rating on the desirability dimension. 

Such a study is not handicapped particularly (at least, directly) by 
differences am.ng faculty in how a particular student is viewed. The concern 
is with the relationships among various traits as they are perceived by an 
instructor, with one trait defir ed as "general desirability," rathei' than with 
actual characteristics of students for whom some general identification as 
desirable might be established. 

One purpose of the present analysis is to examine individual faculty 
ratings and other data on students identified by a faculty consen sus of desira- 
bility. In addition, other data bearing on the agreement among faculty on 
trait ratings of students and the relationship of these ratings to other 
student or faculty characteristics are summarized. Finally, some patterns of 
absence of information about students are examined, for whatever light this 
may shed on the nature of faculty interests and values, and of faculty contact 



with students. 
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Sight institutions 1 provided samples of faculty raters and students for the 
study. At each institution a random sample of 50 to 65 students was drawn 
from the junior or senior class; at one institution an additional random sample 
of freshmen was drawn. 

Two instruments were constructed for this series of studies. One, the 
S tudent Fating B'orm , has already been described in some detail (Davis, 1964a); 
this form provided, in the main, a list of 80 bimodal traits for rating on a 
five-point scale. The second instrument, which provides the major focus for 
this report, was the Student Nomination Form (a sample copy is shown as 
Appendix A). This form provided (for each institutional group) a list of the 
names of the sample of students, used in the larger study, with provisions 
for a faculty member (l) to identify those students in this group whom he 
(a) knew, or (b) knew "very well"; and (2) to nominate any of these students 
to one or more of six laudatory descriptions representing degrees or aspects 
of desirability. These six descriptions involved the categories shown on 
page A-3 this report and deal with promise for (l) societal eminence; 

(2) epitomizing ideals of college; or (3) graduate study; or, with belief that 
the student showed (4) intellectual growth; (5) personal growth; or that he 
was (6) otherwise generally desirable as a student. The Student Rating Fora, 
therefore, provided a relatively simple procedure for polling the general 
faculty and for permitting th^n to place or fail to place known students in 
several categories of promise or desirability. 

Amherst, Caltech, Co" ell, Dartmouth, MIT, RP1, Rutgers, and Stanford. 
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Procedure 

2 

For each student in the samples, two current .Instructors (selected 
randomly from the class lists) were alerted at the beginn ng (and asked at the 
end) of a term to i'ate that student on the Student Rating Form. In addition, 
at seven of the institutions, an institutional representative identified all 
faculty who may have had, through ; .ssignment to undergraduate courses or 
any advising responsibilities, contact with any of the students in the cample. 

At some institutions (e.g., Amherst), all resident active faculty and a number 
of administrators vie re approached; at others (e.g., Caltech, where many faculty 
hold research appointments) only a small portion of faculty listed in the 
catalog were involved. Some biases may have been operating in the selection 
of the sample, and surely some faculty were excluded who may ha 1 e known some 
of the students. Failure to secure 100$ returns also indicates that it is 
likely that the more cooperative (or thos^ more cordial to social research) 
participated; yet it is suspected, from comments elicited upon follow-up, that 
the bulk of nonrespondents simply did not know students in the sample. The 
numbers of students and faculty involved with the Student Rating Form and the 
Student Nomination Form are given in Table 1, together with date on returns. 

Other data available for all students included Scholastic Aptitude Test 
scores (SAT-V and SAT-M) (pre-college administration), high school rank (HSR), 
freshman grade point average (FGPA), cumulative grade point average (CGPA), rank- 
in-class, and scores from the Myers-Briggs Type Indicator (MBTl) (Myers, 1962) 
(administered in the student's freshman year). In addition, for one or more of the 
institutional groups, scores for the following instruments were available: the 

2 

At one institution (Dartmouth) attempts were made to obtain for each 
student every current teacher and the major adviser. 

ERjC 
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Totals 487 1,291 911 71 445 485 1,130 
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Allport-Ve rnon-Lindzey Study of Values (AVL), the California Personality 
Inventory (CPl), the Edvards Personal Preference Schedule (iSPPS), the Person- 
ality Research Inventory (PRl) (Saunders, 1955), the Strong Vocational Interest 
Blank (SVI3), and the Brown -Koltzman Survey of Study Habits and Attitudes (SSEA). 

Preparation of data from the Student Nomination Form . For each 
institutional group separately, a number of "scores" were extracted from the 
Nomination Form. These included, for each student in the sample, the number of 
faculty knowing that student (the "Acquaintance 1 score); the number of faculty 
nominating the student to one or more of the desirability categories (the 
"Desirability Consensus" score); the number of faculty knowing but not 
nominating the student (the "Undesirability" score); and the number of nominations 
to each of the six categories of desirability (societal eminence, epitomizing 
ideals of college, etc.). 

Prep ar ation cf data from the Student Rating For m. Previous work with the 
Rating Form (Davis, 1964c) has involved factor analytic study resulting in 
several rotational solutions to determine the structure of the ratings. The 
equamax rotation was selected, as the better of the two orthogonal solutions, 
for providing a basis for factor scores. For each set of ratings, scores for 
the 18 factors were computed, using a regression weight method. In addition, 
for each student , the average (over the several sets of ratings) score for the 
general desirability item (appearing as one of the 80 traits) was computed as 
a separate measure of desirability. 

Analysis of data . Within each institutional group, correlations were 
computed among the Student Nomination Form indices (Acquaintance, the Desira- 
bility Consensus, and Undesirability), SAT-V and SAT-M, High School Rank, 

Freshman and Cumulative Grade Point Averages, the four continuous scores from 

o 
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the Myers-Briggs Type Indicator (El, or Extraversion vs. Introversion; SN, or 
Sensing vs. Intuition; TF, or Thinking vs. Feeling; anc] Jp, or Judging vs. 
Perceiving), and the separate desirability rating from the Student Rating Form. 
In addition, correlations between Nomination Form indices and the scores from 
the various personality and interest inventories were computed for those groups 
with da to available. 

The reliabilities of the items and of the factor scores from the Rating 
Form vere estimated using a special procedure developed by Ebel (lyjlj. Ihis 
technique, based on analysis of variance, affords a test of agreement among 
raters, where the identity and number of raters varies from subject to subject. 
Excluding those students for whom only one set of ratings with 5 0$ or more of 
the items completed had been obtained yielded 213 students for whom ^>10 sets 
of ratings were available. The analysis of rater agreement was conducted with 
this sub sample. 

Analysis of variance procedures were used to test for relationship between 
frequency of nomination to each of the six Student Nomination Form categories 
on one hand, and, on the other, (l) the 18 factor reeves derived from the 
Student Rating Form, SAT, and high school and college grades; {?.) SAW imi 
RAT-M; (3) EG PA; ( } j) the Nomination Form Acquaintance score; (t) the number of 
items, of ^he total of 80. omitted on the Student Rating Form; anti (6) the 
Rating Form desirability item score. These analyses were conducted for each 
institutional group separately and for the combined group. The subgroups of 
students on the six Nomination Form categories vere established by preparing, 
for each of the six categories and each institutional group, the frequency 
distribution of number of nominations to that category, and by dividing the 
group into two parts of as nearly equal size as possible (since frequency of 
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election to any given category varied substantially from institution to 
institution, the numerical value of the cutting point varies). 

Analysis of variance procedures vere also used to explore the relation- 
ship between the 18 factor scores and institution, the student' s area of 
academic major, the type dichotomies from the Myers-Briggs Type Indicator, the 
rank and teaching field of the faculty rater, and a number of categories 
reflecting extent and kind of contact between the student and his faculty 
rater. 

It should be noted that in the two sets of analyses of variance, the unit 
of analysis is the set of ratings rather than the student --that is, each 
separate set of ratings on the Rating Form was treated as a different case. 

On the Rating Form, raters vere given an option to omit items vhere they felt 
they had insufficient knowledge or contact to form an opinion. For the analyses 
involving Nomination Form categories against Rating Form categories and major 
variables, only those sets of ratings with 50 $ or more of the items completed 
vere employed (this yielded, for the eight institutional groups, 696 sets of 
ratings on d9& students by ^07 faculty members). For the analyses involving 
factor scores and institution, academic area of student and rater, and rater 
contact with student, all available sets of ratings ( 91 l) vere used {regardless 
of the number of omitted items). 

Finally, it was felt that identification of frequency of omits by item 
on the Rating Form might illuminate what the faculty members felt vere important 
to observe or had the opportunity to observe. Therefore, tallies vere made of 
frequency of omits by items and of omits among items grouped according to the 
factor (of l6 rating scale factors) on which they had the highest loading. 

Also, differences In omits for groups of items vere examined by institution* 

o 
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by class (freshman vs. senior) in one institution with such data, by teaching 
department, by teaching division of rater, and by college and teaching division 
of rater. In these analyses, data for one additional institution (Stetson 
University) were available and were included. 

Results and Discussion 

Responses to the Student Nomination Fo rm> As might be expected, there were 
substantial variations among the institutions in the extent to which students 
were known and nominated to one or more of the six laudatory categories; these 
variations probably derive primarily from differences in the si;;e of the student 
body and faculty and thus from the likelihood that a given faculty member would 
know any particular student, A number of selected comparisons are given in 
Table 2, It may be seen here that the proportion of faculty respondents know- 
ing one or more students in their institutional sample varied from 4l$ to $6$, 
and the proportion nominating one or more students to a laudatory category 
varied from 31$ to 9 2$. Put another way (rows 10a and 11a, Table 2) the average 
number of students known by participating faculty members varied among the 
institutions from 2$ tc 19$ the sample (or contrai iwise, the average student 
was known by 2% to 19$ of the faculty). 

Nevertheless, in spite of these variations, virtually all ( 99 $) of the 
students in the total sample were known by at least one faculty member (row 5), 
and, even more surprising, virtually all (96$) were nominated (row 6) to one 
of the six laudatory categories. Similarly, virtually all students were known 
by one or more faculty members who failed to nominate them (row 9) to any of 
the six desirability categories. The provision of u form permitting nomina- 
tions of students may have forced some fueling of compulsion to nominate then, 
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iry or Seleeteu Types of Responses to the Student Nomination Form 
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although the instructions clearly did not require that known students be nom- 
inated; and, those known but not nominated may not have been known very veil. 
Indeed, of 1485 instances where faculty knew students but failed to nominate 
them, only 101 (or 7$) of these were instances where faculty knew the students 
"very well, 11 The fact is, however, that for practically every student in the 
samples there was somewhere at least one faculty member who felt at the ieast 
that that student was a desirable student (e.g., one of those who "represent 
well some qualities and characteristics which make them desirable students for 
this institution") and another who knew him but failed to nominate him as 
desirable in any sense. 

If only tlie top three categories are considered (rows 8 and 8a), of 
the students in the samples were nominated; almost one-half were placed in the 
nest exclusive category which states promise for "substantial contributions 
to society." 

This liberality of nominations may, oi course, be influenced net only by 
the instrument but al^o by a conviction of faculty members the' attainment of 
admission or upper class status in this college attests promise or desirabilit 
Nevertheless, for the institutions studied, the admissions and/or attrition 
process, or the simple fact of variety of faculty members, here yields a re- 
sounding stamp of faculty approval, somewhere, for virtually every student. 

Relationship of nominations indices to other measures . Although each 
student may have a proponent somewhere among the faculty, theie are striking 
differences in visibility and number of proponents (Table B-l in the appendix 
gives some data for a random subsample of Amherst seniors). One nr.v still ask 
if there are factors associated with visibility and wide recognition of general 
promise or desirability. 
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Correlations among the Nomination Form Acquaintance, Desirability, arid 
Undesirability scores, and SAT, grades, Indicator scores, and the desirability 
rating from the Student Rating Form are given in Tables 3 , 4, and 5. The 
Acquaintance score (number of faculty knowing the student) (Table 3) is, of 
course, related to the other two Nomination Form scores (the Acquaintance score 
is the sum of the Desirability and Undesirability scores). The higher 
relationship of Acquaintance to the Desirability portion may indicate that to 
know a student is to like him, or it may simply be a function of the greater 
range of the Desirability score (e.g., for Amherst '62, the standard deviations 
for desirability and undesirability are 5«£ and 3.2 respectively). Nevertheless, 
the relationships between Acquaintance and the test score or grade indices 
are not striking. Only two (of l6) relationships with SAT scores are significant; 
one relationship is positive and the other negative. A similar picture holds 
for the high school record* In all cases but one (Amherst freshmen), 
relationships with college grades are positive, and several are significant 
at the .05 level. Visible or memorable students could conceivably be those 
making very high or very low grades, or those very bright or very gross, though 
scatterplots reveal no evidence of curvilinearlty . It is reasonable to assume 
that many factors affect visibility --numbers of faculty members knowing the 
student, the son of an illustrious person, the athletic eta r, the student who 
wants to become known, may all become visible to many faculty. In itself, the 
Acquaintance score seems to have no particular meaning in terms of the control 
variables, except for some slight tendency for faculty to know those w f ith be 1 ter 
grades. 

The De 'inability score (Table 4;, c c other hand, seems clearly related 
to the college grades indices. While th* majority of relationships with the 

o 
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preadmissions measures are positive, few are significant. Relationships with 
the Rating Form measure of desirability are all positive, and four are significant 
this is striking, considering the fact that the Rating Form desirability score 
is a single rating or an average of single ratings by two or three faculty members 

If all students had the same number of faculty members knowing them, the 
Undesirability score would have had, as a reciprocal, perfect negative relation- 
ship with the Desirability Consensus score. Except for Amherst freshmen (and 
perhaps the Caltech and Cornell Groups), these two indices do not appear to be 
related, in spite of the potential built-in bias. By definition, the 
Desirability Consensus score focuses on students visible in positive ways, 
while the Undesirability score focuses on students visible in negative ways; 
neither may be assumed to identify the student who may be nondescript because 
he has not impressed himself on many faculty members in any way. Table 5 shows 
that generally the most recent grade index is most likely correlated with the 
Undesirability score and that relationships are in the expected direction. The 
fact that the coefficients between grades and Undesirability are not as high as 
are the relationships between grades and Desirability would suggest that the 
unexplained variance for Undesirability leaves more room for qualities not sub- 
sumed by the grade criterion. This does not hold for Amherst freshmen, where 
relationships for Desirability and Undesirability with both grades and 
preadmissions indices tend to be high; this may indicate that these students 
simply have not been around enough for faculty to obtain much impression of 
the personal qualities which assumedly enter into judgment of desirability. 

How many faculty members may have consciously attempted to recall aca- 
demic performance of known students, or checked records before completing 
the Nomination Form, is not known. Nothing in the instructions or in the 

o 
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brief task the Nomination Form presented would seem to precipitate a bias that 
would artificially inflate the relationships with grades. 

Yet, whatever frames of reference faculty use in nominating or failing 
to nominate students, the academic performance level of the student seems a 
rather substantial predictor of such favor in the eyes of the faculty. 

Therefore, it is probably best to conclude that the grade average subsumes 
many of the qualities faculty consider in making the solicited nominations. 
Grading is the system of human evaluation in which the faculty are skilled and 
practiced; these results would indicate that this evaluation is rather pervasive. 

The relationships between the indices and scores from the Myers -Briggs 
Type Indicator (Tables 3, 4, and 5) are relatively uninteresting. An occa- 
sional coefficient approaches or reaches significance, though there are no 
strong evidences of consistency. Myers’ (19&2) emphasis on the fourfold 
typology (rather than score continua) as the frame which may produce meaningful 
results (e.g,, the thesis that scores on one of the four indices are likely to 
behave in an orderly fashion when moderated by the other three), or her frequent 
finding of curvilinearity in regression, may mean that the present analysis is 
too gross to permit any significant findings. However there is no strong 
evidence that the three Nomination Form scores are related to the continuous 
scores cn the Indicator. 

The Nomination Form Desirability Consensus and Undesirability scores 
evidence relationship in the expected directions with the Bating Form Desira- 
bility score. Although these relationships are not markedly high, they appear 
to contribute reasonable validity to the latter index, where reliability is 
restricted by the fact that it is in most instanjes, as noted, a single Judg- 
ment or an average of two judgments. (rn fact, data presented later in this 
report provide a 2 suability estimate of r = [see Table y, page U, item 
80] for this criterion.) 
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Relationships between the Nomination Form indices and the other test score 
variables- -AVL, CPI, EPPS, PRI, SVIB, and SSHA--vere generally nondescript, 
in that no more significant relationships than vould be expected by chance were 
found and that those significant were inconsistent or lacking obvious logic. 

Data from the Allport-Vernon-Lindzey Study of Values were available for the 
Amherst senior and RPI groups. Correlations between the three Nomination Form 
indices and the six AVL scores are shown in Table 6. 

Table 6 

Relationships between AVL and Nomination Form Indices for Amherst and 

RPI Samples 



Amherst 

(N=62) 



RPI 
(N=37 ) 



AVL Index 


Acq. 


Des. 


Undes. 


Acq. 


Des. 


Unde: 


Theoretical 


25 


22 


11 


30 


07 


34 


Economic 


02 


-03 


17 


-10 


-06 


-08 


Aesthetic 


00 


05 


-08 


19 


03 


23 


Social 


■07 


05 


-21 


-02 


09 


-l4 


Political 


-12 


-19 


10 


-01 


-05 


04 


Religious 


-07 


-Oh 


-07 


-21 


-05 


-23 


Amherst, the 


Theoretical 


scale 


was related 


significantly 


to SAT-M 1 



the Economic scale related significantly to SAT-V (r=.50), SAT-M (r=-.33),» 

HSR (r=-.32), FGPA (r=-.U5) and CGPA and the Aesthetic scale related 

significantly to SAT-V (r=.43). In these instances at RPI, relationships 
were in the same directions, but none were statistically significant. There 
may be tendencies for students scoring nigh on the Theoretical scale to be 
more visible; on the other hand, the patterns are not sufficiently established 
that any brief could be held for students’ values ..s here measured affecting 
their visibility or desirability. 

o 
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Data from the California Personality Inventory were available for the 
Stanford Sample. For the l8 CPI scales and the three Nomination Form indices, 
only five of the 5^ intercorrelations reached or exceeded a value of r=.15, 
and no relationships were significant. The Edwards Personal Preference 
Schedule data were available for Amherst freshmen and for Amherst seniors. 

For its 15 scales and the three indices, only five of the 4 5 intercorrelations 
reached or exceeded a value of r = .15 for the seniors with only one of these 
five significant. For the Amherst freshmen, nine of the 54 intercorrelatic :is 
reached or exceeded r=,15, and none were significant. 

The Survey of Study Habits and Attitudes, available for Amherst seniors, 
proved somewhat more interesting; relationships of the SSHA score with 
Acquaintance, Desirability, and Undesirability were, respectively, r=.00, 

. 19 > and -,3?j the latter being significant at the .01 level. As in the 
studies reported in the manual (Brown and Holtzman, 195^), relationships of 
the SSHA with ability scores are negligible, while relationships with grade 
performance are moderate and positive (e.g., for SSHA and cumulative GPA, 
r=.32)j this means, however, that the relationship between SSHA and Undesir- 
ability, for example, may be explained by their mutual dependence on grades. 

Strong Vocational Interest Blank (scored on 48 scales) data were avail- 
able for the Stanford group; of the 144 intevcorrelations with the three 
Nomination Form indices, only two were significant (correlations in the minus 
fifties between the Parmacists' scale and Acquaintance and Desirability). 

Of course, there are too many variables, too few cases, and too little sub- 
stance for anything to be made of these results. 

An exception to the general trend of these findings is provided by the 
Personality Research Inventory data from the Cornell School of Engineering 
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group. Correlations between the Acquaintance score, the three desirability 
indices, and the 25 PR I scales are given in Table 7 (for a description of 
these scales, see Saunders /l9557)« In spite of the low reliability (Messick, 
1962) of the PR1 scales, and the fact that this self - ref^ort inventory was ad- 
ministered three years prior to the time ratings and nominations were obtained, 
a number of interesting findings emerge. 

The engineering student known by many faculty (from the Acquaintance score) 
appears to be one who describes himself as talkative, possessing social know- 
how, who is practical rather than artistic, and who is net concerned with mental 
exercise for its own sake. The valued student (from the Desirability and 
Undesirability scores) describes himself as lacking in insight, anxious, 
patient or tolerant of frustration, able to control impulses, altruistic, 
finding zest for completion of tasks (attitude toward work), not concerned with 
status as such, socially knowledgeable and extroverted, practical, and dis- 
daining the sort of intellectual interest that marks the stereotype of the ideal 
liberal arts student.. In terms of the item content of these scales, we find that 
the faculty like students who describe themselves as preferring prose over 
poetry, newspapers over books, photography over painting, and popular over 
classical music. These favored students do not see themselves as venturesome, 
having a sense of humc r or self-understanding, having interest in developing a 
personal philosophy of life, nor do they enjoy ’’thinking hard.' 1 And, they 
would rather use a computer than design a new one. 

Although the numbers are small and replication (perhaps with a bolstered 
PRT ) is highly desirable, the suggestion is that the student's report of need.,, 
drives, and expectancies through the PR1 may prove a useful tool in predicting 
faculty reaction to him. Institutional factors may be a part of such 
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Table 7 

Relationship of PR I Indices to Acquaintance and Desirability Indices 
(Corne. l 1 School of Engineering; N=50) 



Scale 




( ACQ.) 


(UNDES.) 


(DES.) 


SRF 

DES* 


1. 


Insightful 


-06 


27* 


-27* 


-24 




Anxiety 


-15 


20 


-31* 


-08 


3. 


Self-accepting 


-02 


20 


-17 


-20 


4. 


Tolerant of frustration 


-01 


-28* 


21 


05 


5. 


Tolerant of ambiguity 


- 2 k 


-09 


-18 


-10 


6. 


Compulsive 


-02 


-03 


00 


00 


Y. 


Impulsive 


-l6 


26 


-37** 


-33* 


8. 


Altruistic 


18 


-18 


32* 


09 


9- 


Talkative 


39** 


19 


26 


04 


10. 


Self-sufficient 


-06 


-08 


00 


22 


11. 


Gregarious 


12 


-06 


18 


10 


v>. 


Conformity in handling aggression 


18 


-05 


22 


-03 


13. 


Attitude towail work 


18 


-15 


31* 


27* 


14. 


Foresight 


14 


-02 


16 


-17 


15. 


Belief in individual freedom & responsibility 


-16 


-24 


02 


-18 


l6. 


Belief in over-al] group values 


-15 


-22 


01 


12 


17. 


Social conscience 


16 


-01 


17 


03 


18 . 


Status aspiration 


22 


27* 


02 


-1? 


19. 


Social know-how 


32* 


01 


33* 


00 


20. 


Social status 


?-5 


-02 


27 * 


15 


21. 


Masculine vigor 


25 


10 


18 


16 


22 , 


Art! f 1 ic vs . p ra c t ic r u 


-30* 


06 


-35** 


-23* 


23 . 


S pi j ■ i t u al vs, mate riaL 


-13 


-23 


05 


09 


? 4 . 


1 regressive vs. conservative 


-03 


09 


-10 


02 


23. 


Likin' to think 


-27* 


-01 


-27* 


-21 



* Signili .-ant at .05 i r . ve L 

** Signif i :ant at .01 U cel 
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relationships, however, for the Cornell group also produced three (of five) 
significant relationships between the Desirability score and MBTI indices 
(desirable students more sensing than intuitive, more thinking than feeling, 
and more judging than perceiving). The raters at Cornell consisted of the 
entire engineering faculty; this homogeneity, as veil as the homogeneity of 
program and students, may also be a factor in these relationships. 

Re3 ationship of nomination to laudatory cal -egories to the major variable s . 
The Rating Form provided not only the three indices disclosed to this point, 
but also six different ways of describing promise or desirability: (l) societal 

eminence, (2) epitomizing institutional goals, (3) promise for graduate study, 
(^) intellectual growth, (>) personal growth, su;d (6) otherwise desirable. 

The summary of the analyses of variance for groups derived from frequency of 
nomination to these categories against SAT. FGPA, the Myers -Briggs continuous 
scores, the Acquaintance score, the number of omitted items, and the average 
of the Rating Form criterion of desirability are presented in Table 8. This 
table provides the F ratios for those comparisons where significant differences 
in means on the variables were found for the more frequently vs. less frequently 
nominated groups, together with a symbol indicating direction of the difference. 
Here, the symbol 11 >" indicates tne higher mean on ~he variable in question 
was obtained by 'the more frequently nominated group, and the symbol " < 11 indi- 
cates the higher mean was obtained by the less frequently nominated group. 

The most notable and consistent finding for the institutional g 2 *oups con* 
sidered separately is the finding that those nominated more frequently in the 
first three cat./ories have (c-r had) higher freshman grade point averages in 
all instances except for categories 2 and 3 at 1F1 and category 1 at Stanford. 
Again, academic performance is verified as the najor universal component of 

o 
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desirability as a student. The Student Rating Form desirability score, again 
with the exception of RPI and Stanford, also tends to confirm nomination to 
the first three categories. The SAT is not so clear-cut as a component of the 
nomination to laudatory categories, except at Dartmouth; here, it is particularly 
apparent in the nominations for premise for graduate study {category 3)* 

The Myers -Briggs Type Indicator continuous scores produce generally no 
orderly and consistent patterns, except at Dartmouth where those students 
more frequently nominated in categories 1, 2, 3, and 6 appear more introverted, 
and those nominated for personal growth more extroverted. 

For the combined institutional group, the differences are clearer. 

Academic performance and SAT-V stand out nicely for the first three categories. 
The personal growth category appears reserved for those with lover SAT-V and 
SAT-M scores and/or for the extroverted-sensing- judging (or ES-J) "types. 1 ' 

The Rating Form criterion of desirability is again confirmed for the first 
four categories. Category 6 does not, for the combined group, seem related 
to any of the variables. 

Inter-rater agreement or. Student Fating Form indic es. It was suspected 
from the beginning of work with the Rating Form that agreement among raters on 
a particular student would be limited. Some special care was therefore taker 
to ensure good ratings: raters dealt with students in current classes, knew 

two to three months ahead the precise nature (and content) of the task facing 
them at the close of the term, and were warned, through special instructions, 
of the common errors in rating. Yet, the Fating Form vas based on the language 
(or, more exactly, labels) faculty use in referring to students rather than on 
behavioral description; there '/ere no fornal, standard observational situations, 
and kind and degree of contact vsried. For example, at Rutgers, one instructor 
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invited his ratees home for dinner ard questioned them extensively on a range of 
topics; another reported limited confidence in his evaluations- -as an art 
instructor working entirely with slides, he taught his classes in the dark and 
had never seen his subjects. Also, previous study of a sample of students 
at MIT rated on an earlier Rating Form used in this series revealed that marked 
disagreement between two raters could be explained frequently by a single, 
dramatic event (e.g,, falling asieep in one class) which colored many of the 
’separate" traim evaluations. And finally, note must be taken of the fact that, 
after all, contact between instructor and student in most natural college 
settings is rat ‘her limited indeed. 

The results of the analysis of rater agreement on the 80 items of the 
Rating Form are presented in Table 9 j the reliabilities of the factor scores 
ere presented in Table 10. Although, considering all aspects of the situation, 
the item reliabilities appear reasonable, the composites provided by the factor 
scores are nci reliable enough for any confidence. It should be recalled that 
the factor scores were computed by a regression method, and that each, therefore, 
is based on various combinations of 84 variables: the 8o items of the Rating 

i hin, SAT-V, SAT-M, HSR, ana FGPA. For the factors defined principally by SAT 
and by grades, reliabilities would be perfect were it not for the error 
introduced by the ratings- -for, in this analysis, a student could have two 
different ratings but only one score or grade average of record (thus, the 
"reliability" of these two factors can be discounted). Future studies involving 
scores based on combinations of trait ratings, if warranted at all, should 
probably involve simple addition of item scores, perhaps following a less 
complex structure such as that suggested by second-order factor analysis 
(Favis, 196 Se). 
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l 

37 

73 

56 

28 

34 

21 

3: 

13 

22 

10 

70 

26 

71 

8o 

46 

52 

16 

50 

4 

38 

40 

25 

6l 

24 

2 

6 

79 

19 

14 

64 

20 

31 

5 

7 

76 

48 

53 

65 

36 

74 

17 

32 

39 

c 
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Table 9 

Reliability of Ratings for Individual Items* 



Conten t 

intellectually quick 
high academic performance 
makes good grades with ease 
high intellectual curiosity 
high motivation to achieve 
good at analyzing 
interested in ideas 
intellectually nature 
willing to ask questions 
above average ability 
eager to learn 

has broad intellectual interests 
a serious student 
self-di sciplined 
placid 

the kind 02 ' student this institution 

reads widely 

creative 

shows originality 

industrious 

imaginative 

thorough 

deep 

good grasp of abstract 
performs to top of ability 
conventional 
works steadily 
gregarious 

high level of physical energy 
honest 

meets deadlines 

intellectually versatile 

socially mature 

self - directing 

pleasant 

independent 

modest 

orthodox it behavior 

stable 

affable 

low need to stand out 
at home in college culture 
cooperative 
personal gpals clear 
not status-centered 



Reliability 

.42 

.41 

.38 

.36 

.33 

•32 

•32 

.31 

.31 

.31 

•31 

.31 

.31 

.30 

.30 

should admit .29 

• 29 
.29 
.28 
.27 
.27 
.27 
.27 
.27 

• 27 
.26 
.26 
.26 
.26 

• 25 
•25 
.24 
.24 
.23 
.22 
.22 
.22 
.22 
.21 
.21 
.21 
.21 
.20 
.20 
.20 



* 
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Table 9(continued) 



Item Content 

15 interested in others 

69 open to new experience 

78 good sense of humor 

12 conforming 

3 high interest in chosen field 

67 principled 

23 calm 

18 active in campus life 

8 culturally rich 

42 extroverted 

45 open-minded 

30 leader among peers 

63 cpt ini Stic 

60 accepts majority values 

44 sophisticated 

51 high concern for welfare of ot' 

72 has few idiosyncrasies 

58 realistic in outlook 

43 acts ethically 

4 l willing to take direction 

9 flexible 

62 completes undertakings 

27 altruistic 

29 likeable 

66 works veil with others 

77 generally objective in forming 

79 high respect for human dignity 

68 values like those of faculty 

47 good self -understanding 

39 happy 

57 fair-minded 

54 liked by peers 

55 low need for reassurance 

59 positive family influence 

11 seldom worries 



R eliabili ty 

.20 
.19 
. 1 ? 

.19 
.19 
.18 
.17 
.17 
.17 
.16 
.16 
.16 
.15 
.15 
.14 
.13 
.13 
.13 
.12 
.12 
.11 
.11 
.11 
.11 
.11 

opinions .10 

.10 
.09 
.09 
.09 
.07 
.05 
.05 
.05 
.01 



*For 

procedure 



definition of reliability 
on page 6 of this report. 



coefficients ard 



sample , 



see description of 
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Table 10 

Reliability of Ratings for Factor Scores* 



Factor 


Reliability 


SAT 


.92 


Grade achievement 


•77 


Ext ravers ion 


.29 


Intellectual ability 


.21 


Ethical. - ) ty 


.20 


Intellectual values 


.19 


Status ~c ante redness 


•17 


Maturity 


.16 


Conformity 


.15 


Likeableness 


.12 


Altruism 


.12 


Dependability 


.12 


Popularity 


.08 


Self- insight 


.08 


Motivation 


.08 


Anxiety 


.06 


Self-s uff iciency/c reativity 


.04 


Open-mindedness 


.03 



*For definition of reliability coefficients and sample, see 
description of procedure on page 6 of this report. 
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Therefore, no special note is taken of the analyses of Nomination Form 
indices against Hating Form indices. Summaries of the analyses of variance for 
Hating Form factor scores against the six Nomination Form categories and the 
other variables (teaching field of rater, kind of contact vith ratee, etc.) are 
presented in Appendix C, together with brief comment. 

Analyses of omitted it e ms on the Student Rating Form . The frequency with 
which each of the 80 items on the Hating Form was answered vith a "don't know" 
rather than with an evaluation is given in Table 11, which is based on the 
total group of ratings. Of first interest is the variation in the range of 
proportion of c.hts: the least frequently omitted item (pleasantness) was 

absent in only 6$ of the rating sets, while the most frequently omitted item 
(quality of family influence) was absent in 84$ of the rating sets. 

Of greater interest, however, are the general kinds of items seldom 
omitted vs. the general kinds frequently omitted. The least frequently omitted 
items have to do with the student's general interpersonal impact on the 
instructor (pleasantness, likeat eness, cooperativeness, affability), his 
academic ability and performance, and his industry in assigned tasks. On the 
other hand, the most frequently omitted items involve the student's role on 
campus or among peers; intrapersonal qualities, such as self-understanding, 
status-centeredness, or tendency to w'orry; and Items having to do with altruism. 
The latter is somewhat surprising, as is the 65 $ omit on breadth of reading; 
faculty members, particularly in the liberal arts, might be expected to be 
tremendously concerned about these areas. If they really are, they find 
observations and evaluations of the student in these terms difficult to nab. . 

In the case of altruistic values of students, faculty may be hesitant to press 
their inquiiy far into the conscience and away from the intellect, and self- 
regard characteristics would te hard to observe or infer. The absence of 

ERIC 
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Table 11 



Student Rating Forsi Items Ranked by Frequency of Ctalt 6 
for Upperelaes Groups In 1?62 CSCS Sample*- Ratings (N=973) 



Item No. 


Trait 


i OmitE 


Item, No. 


Trait 


% Ctaits 


5 


Pleasantness 


6.1 


25 


Grasp of abstract 


29. C 


1 


Academic performance 


7.2 


69 


Openness to new experience 


29.1 


29 


Likeablenes 


8.0 


56 


Motivation to achieve 


29.5 


13 


Ability 


8,1 


2C 


Social maturity 


29,7 


33 


Willingness to ask questions 


9.2 


79 


Level of physical energy 


29.7 


1? 


Cocperatlv^ness 


10.6 


12 


Conformity 


30,1 


22 


Eagerness to learn 


11.O 


5? 


Creativity 


30.7 


70 


Seriousness as student 


11.1 


40 


Depth 


31.4 


50 


Industry 


n.5 


31 


Self-direction 


31.6 


76 


Mode sty 


12.1 


43 


EtbicaL 


33.0 


65 


Affability 


22.3 


10 


Intellectual interest 


33-2 


49 


Intellectual quickness 


12.6 


64 


Intellectual versatility 


33-6 


38 


Thoroughness 


14.6 


44 


Social sophistication 


33-9 


71 


Argumentativeness 


14.7 


67 


Principled 


34.0 


23 


Tenseness 


14.9 


57 


Fa 1 r-ainiedness 


35.7 


14 


Meeting deadlines 


l'j.f 


77 


Objectivity 


35.9 


41 


Willingness for direction 


16.2 


?8 


Rc-alisra of outlook 


36.4 


21 


Intellectual maturity 


l'.3 


72 


Idiosyne retie 


3 6.0 


4 


Iraagl na t i vene s s 


17.6 


35 


Happiness 


37.2 


61 


Performance per ability 


17.6 


63 


Optimi sm 


37-8 


26 


Analytical ability 


17.7 


15 


Self- cents redness 


4C.6 


73 


Intellectual curiosity 


16.0 


32 


Clarity of personal goals 


41.5 


34 


Interest in ideas 


16,8 


6 


Cultural richness 


42.0 


2 


Steady work 


19.6 


3- 


Leadership among peers 


43.1 


16 


Originality 


20.3 


66 


Ability to vork with others 


43.2 


78 


Sense of burner 


20.9 


36 


Need to stand out 


44,1 


62 


Completes unde t takings 


21.0 


54 


Liked by peers 


45.6 


53 


Stability 


22 . 2 


55 


Need for reassurance 


46.4 


46 


Orthodoxy (in behavior) 


2 2.5 


60 


Acceptance of majority values 


47. S 


42 


Extraversion 


2c .6 


6S 


Values like faculty 


46.3 


24 


Conventionality 


23.3 


4? 


Self ‘Understanding 


50.5 


7 


Independence 


23.5 


75 


Pe spe c t fo r human di gn i t y 


50.5 


45 


Open-mindedness 


23.6 


11 


Tendency to worry 


51.4 


26 


Self-discipline 


24.0 


16 


Participation in campus life 


53.8 


6 


Gregariousness 


25.0 


51 


Cor.c». m for others’ welfare 


56.1 


19 


Honesty 


25.4 


59 


Status-centere iness 


56.6 


37 


Ease in taking grades 


25.6 


27 


Alt rui sm 


59-9 


9 


flexibility 


27.5 


46 


Preaith of reading 


64.7 


74 


Ease in college culture 


28.0 


59 


<3 jail tv of family influence 


64.1 


3 


Interest In chosen field 


18. 5 









♦ Amherst, Caltech, Cornell (Engineers), Dartmouth, JUT, RPI, Rutgers, Stanford and Stetson 
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knowledge about breadth of reading- -confirmed by relatively frequent omission 
of intellectual interest, versatility, and "values like faculty" --tends to 
suggest that in the playing out of most courses, faculty do not or cannot press 

hard to probe these depths. Instead, they react to the student in terms of 

his personal warmth, his academic ability and performance, and his orderly and 
thorough attention to assignments. 

3 

Table 12 shows the proportion of omits by institution and for the 79 items 
grouped in terms of the factor on which they had the highest loading. Of 

primary interest is the variation by institution as well as the previously 

noted variation by type of item. For the former variation, both Stetson and 
Amherst faculty omitted fewer than 20# of all items, while the proportions 
exceed 40# for Stanford, Cornell, and MIT. With regard to variation by 
factor cluster, it is interesting to note that three areas found previously 
(Davr's, 1964b; Davis, 1964 d) to be associated with desirability apart from 
grades (ethicality, intellectual values, and altruism) are in the most fre- 
quently omitted half of the distribution, while likeableness is the least 
frequently omitted factor cluster. Perhaps some attention might be given 
to ways of facilitating the visibility of these other qualities within the 
structure of upper-class course work. 

The institutions (columns) and factor cluster areas (rows) in Table 12 
at'e ordered in terns of frequency in the total compilations. Within the ranks 
across rows or columns there are some interesting variations. These may be 
more readily observed from data presented in Table 13> where the variation 



"The general desirability item war omitted from these analyses. 
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G. Likeableness 

B. Intel, abll. 

A. l-epencability 

H. Ext reversion 
F. Motivation 

I. Self- sufficiency 
L. Maturity 

J. Open-mindedness 
E. Ethlcality 

C. Ccnformlty 
ti. Anxiety 

D. Intel, val. 

R. Status -cent. 

H. Popularity 

K. Altrjiaa 

0. Self- insight 

No. F stings 
% Itfcas Omitted 



O 




Table 12 



STETSON 


Percent 
(Based on 

AMHERST 


of Omits 

79 items 

HPI 


for Factor Groupings of Items, by College 
973 ratings, 1962 CSCS Upper-class Sample) 

DARTMOUTH RUTGERS CALTECH STANFORD CORNELL 


MIT 


ALL 

COLLEGE TOTAL 


2.3 


2.1 


7.8 


5.3 


5.8 


11.4 


19.6 


22.2 


18.2 


9.2 


10.3 


4.1 


12.4 


16.9 


ll.l 


24.0 


30.4 


21.3 


23.5 


16.7 


8.7 


8.0 


13.3 


15.4 


16.0 


20.9 


33. C 


27.1 


32.5 


10.0 


11.6 


16.2 


16.7 


19.9 


20.5 


25.1 


35.5 


34.3 


40.3 


22,0 


13.1 


i6. e 


22.4 


23.6 


23.6 


26.7 


41.0 


37.3 


44.2 


£5,7 


16.7 


13.2 


24.1 


22.0 


21.5 


26.8 


39.1 


45.5 


40.7 


£5.9 


12.2 


15.6 


30.6 


19. 7 


25.3 


29.1 


44.0 


46.3 


49.6 


or, 2 


17.0 


16.0 


27-3 


26.4 


27.8 


31.2 


41.3 


46.1 


48.9 


29.2 


10.9 


23.0 


16.1 


26.? 


32.6 


27.2 


52.0 


44.9 


56.6 


3C.0 


19-0 


22.8 


21.7 


20.7 


31,6 


34.9 


46.7 


UV.7 


53.9 


3?.l 


22.4 


2>.0 


26,2 


31.6 


40.9 


35.6 


44.8 


?0.1 


46.1 


3^.4 


21.4 


10.6 


40.8 


20.8 


£5.0 


41.1 


49.4 


59.4 


55.1 


35.1 


20.7 


24.8 


33.9 


33.3 


38.9 


60.7 


48.4 


;i.? 


53.5 


37.7 


24.7 


44.8 


27.6 


46.1 


55.0 


46.1 


69.3 


56.7 


67 .4 


46,5 


34.5 


*»0.1 


40.9 


51.2 


55.6 


51.6 


66.1 


72.2 


74.2 


51.8 


1*0. 6 


•*5.9 


60.9 


?6.9 


64.1 


60.6 


69.4 


74.9 


79.3 


58.7 


166 


106 


56 


161 


90 


153 


84 


09 


. cc 


[r 3 




17 .6 


lu.? 


15.J 


2c- , 5 




31 .9 


43.7 


44.0 


Ub.a 
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Table ljj 



Ratios of Observed Over Expected Frequencies of Oalts 
by Factor Grouping and College { 1962 CSCS Upperclass Sample) 





AMHERST 


CALTECH 


CORNELL 


dahtwotk 


MIT 


RPT 


RUTCERS 


STANFORD 


STETSON 


£f 

r 


it of Total 
R's Possible 
for 

Category 


A. Dependability 


.66 


1.06 


1.01 


.95 


1.15 


.87 


.93 


1.24 


.61 


1225 


18.0 


B. Intel, abil. 


.38 


1.33 


.66 


1,12 


.89 


.88 


.69 


1.23 


1.04 


975 


16.7 


C. Conformity 


1.10 


1.01 


.93 


1.00 


1.07 


.80 


1.02 


.98 


1.04 


1561 


32.1 


D. Intel, values 


.61 


1.09 


1.14 


.91 


1.00 


1.38 


.74 


.53 


1.02 


2047 


35.1 


E. Ethicality 


1.14 


.62 


• 98 


.96 


1.17 


.62 


1.L0 


1.14 


1.03 


699 


30.8 


F. Motivation 


1.01 


.97 


•99 


1.03 


1.0$ 


1.03 


.95 


1.08 


.86 


1249 


£5.7 


G. Likeableness 


.36 


1.15 


1.61 


.64 


1.23 


1.00 


.66 


1.43 


.42 


360 


9-2 


H. Extiavereion 


1.09 


1.02 


1.01 


.97 


1.11 


.87 


.93 


1,06 


.87 


1555 


22.8 


I. Self-sufficiency 


.79 


• 96 


1.18 


• 95 


.99 


1.11 


.67 


1.03 


1.08 


1510 


25.9 


J. Open-mindedness 


.64 


.99 


1.06 


1.01 


1.06 


1.11 


.99 


.96 


.98 


1991 


29.2 


K. Altruism 


1.20 


.93 


.54 


1.10 


• 91 


.93 


1.12 


.66 


1.12 


2013 


51.8 


L. Maturity 


.89 


.99 


1.13 


.81 


1.15 


1.34 


.97 


1.10 


.76 


1059 


27.2 


M. Popularity 


l.LB 


.92 


.62 


1.11 


.92 


.70 


1.23 


1.01 


.90 


1608 


46.5 


N. Anxiety 


1.16 


.97 


.98 


1.02 


.63 


.90 


1.23 


.88 


1.09 


1674 


34.4 


ft. Self-insight 


1.21 


.96 


.86 


1.06 


.65 


1.23 


1.14 


.61 


1.16 


1713 


58.7 


F. Status -cent . 


1.01 


1.01 


.92 


.99 


.90 


I.05 


1.07 


.87 


1.28 


1100 


37.7 


£f 

c 


1607 


3852 


3093 


3376 


2438 


1147 


2024 


2898 


2303 


22742 


29.6 


% of Total R 1 s 
Feasible for 
Instit, 


19-2 


31.9 


44.0 


06.5 


46.8 


25.0 


28.3 


43.7 


17.6 


29.6 




Note: 11 Expected” frequencies 


for each 


cell vere 


obtained 


In the 


conventional mnner, by multiplying column 





freque: ;y by rev frequency over total frequency. 
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which is influenced by both institutional and item content total proportions 
is taken into account through the computation of an expected frequency and 
the reporting of the observed -over -expected ratios. A ratio below 1.00 shows, 
of course, that the factor cluster was less frequently omitted than would have 
been predicted from the total from the institution and the content area. The 
data gen -.rally are reasonable in terms of the nature of the institution and 
are worthy of careful study by the reader. 

In one instance (Amherst), parallel groups of fresnmen vs. seniors were 
available. Raters were not identical, of course, but there was some overlap. 
Results of a comparison, by factor cluster of items, for the two classes is 
given in Table 14. J n most instances, there is fairly uniform gain in pre- 
sumed knowledge of the students, and the seniors are much better known than 
are the freshmen. This is reasonable, of course; but, it also tends to 
confirm an element of conscientiousness and caution by the raters. 

Of final interest in the analysis of omits are the tabulations by factor 
cluster and teaching department of rater (Table 15 ) or teaching division 
(Tables l6 and 17)* Interpretations of these analyses must be qualified by the 
general origin of the content of the Rating Form. For example, one earlier 
study concerned with faculty descriptions of desirable student, behavior in a 
department of education (Myers, 191 ?) produced content for ratings that was 
quite specific to that depart •.out, and quite different from that of the Rating 
Fern. Also, departmental differences may stem from differences among students 
rather than among faculty, as most instructors rated, in the upper-class samples, 
treir own majors. 

In Table bi, there ir considerable variation by department, from 4$ total 
omits for ROTO instructors (who must to accustomed to observation and trait 
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of Omiv.-: V.vrtor Grouping of Ttens: Amherst Freshen vs. Amherst Senio 



SCALE 

fL-LLLilLN SViMOR'p TOTKEs 



c . 


Li koM; L (f i ic ■iis" 


M 


2.1 


3-9 


b . 


L^iM. MU. 


10.6 


4.1 


"i • 3 


A. 






8.0 


11.6 


I. 


£■:. 1 ft'- i one/ . 




13.2 


22 Q 


u # 


Ex t-i*'!* /.’rvilm. 


L9.9 


16.2 


23.0 


l.. 


r-;'L >y\\.y 


15.3 


15.8 


25.5 


r. 


;r \-ftl »;<>;« 


.33*7 


18.6 


26.0 


j. 


i -Hi i il'j-'ir . : r 


56.5 


16.0 


;:6 f 2 


t\ 


Vi.t ? .-a* <: ■ i i 


39/> 


36.8 


28.1 


c. 


i l 


39.6 


itt.b 


31.1 


n. 


t\ \ \ : *■ i'v 


48.1 


25.8 


36,9 




■ V,;- 


r >l . 3 


?4 .8 


jf.9 


?■■ 


; i - ■- U'i ’■ t 


>7.1 


23,0 


39.6 


r. . 


\ ' 1 :■ j 3 ; jf. 


fl .9 


40.1 


55.8 


‘A. 


ty 


74.0 


44.6 


59.3 


C , 


Vl f -jjVi.; *U 


79.? 


45*9 


62.1* 






( iO'O 


(ICC) 




0 : 


j'Ot.fi!..* 


3?. 7 


1^.2 


28. 4' 
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Percent of Oil's for Fa ’tor Cronpintfs of Items, by TeacMn* Department of Rater (Selected Departments only)* 
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Percent of Omits for Factor Groupings of Items , by College and Teaching division' 
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Assignment of department to uivision varies from college to college; division content in each case by catalog groupings, 
•Include.; 1 Arch, and 9 Industrial Management Ratings 
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ratings) against kyfc for Electrical Engineering faculty- In general, the 
engineering, natural sciences (except biology), and mat nematics faculty were 
either more hesitant to rate students or less concerned to observe, with 
economics and history also running high in omits* 

How the factor' cluster areas var y by department of rater is more readily 
apparent from the data in Table 16, where departments are grouped into 
divisions. Frequencies of omits for the social sciences follow very closely 
the proportions for the total group, as, indeed, do the frequencies for the 
natural Sciences (with possible exceptions toward greater number of omits in 
che intellectual values ard open-mindedness areas)- I he proport-ion of omits 
for professional fields are lover in all factor clusters than are the 
corresponding proportions for the total gro-p with the exception of intellectual 
ability, and the omits ror the humanities arc 1 than those for the total 
except for popularity- Tne engineers, as previously noted, run higher 
proportions across ail clusters, with the greatest discrepancy from total 
proportions in the areas oi intellectual values, i iV.eat.il if y, arid maturity, 

For those interested in divisior.-by -institution breakdowns, appropriate data 
for seven of the- institutions (those vitn reasonable N : s in each division) arc- 
presented in Table 17 • Variation by division seems smaller at Amherst, 
Dartmouth, and 1LT and ’’arger at Caltech, Futgers, and Stanford (at Cornell, 
the discrepant division had only eight- cases) 6 

Some Far tin g Sp eculations 

These results could be interpreted to add force to the arg unent for 
r einst -at * me- ni. of grades an fix- criterion in wVi \'h faculty jc-ally Iclicvr. , v. t i t. i j 
f . ? j e additional jrovit„ fivxn picvio-s ciunrs ;* 1 ■ . i f remits r ua* there a t\. 
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less able students vhose socio-ethical heart seems in the right place, and vho 
are therefore nice to have around--or, at least, are not resented their place 
on the campus* A more reasonable possibility is that the qualities sought 
in the basic goals of the study are not amenable to th= relatively superficial 
surface analysis employed, that deeper probing into the personality organiza- 
tion and functioning of the individual student is necessary. Still anotner 
possibility is that the really desirable student emerges from a dynamic 
interaction of traits, producing a number of unique structures but in toto 
resisting fragmentation into the unique trait components which the design 
employed may produce* If so, manageable ways and means to describe the student 
as a whole need to be sought. Also, faculty may need their attention directed 
to specific events or may need their opportunity to observe and study students 
enlarged. 

The nature of the criterion employed here may limit the results. With 
virtually no student for whom some faculty member did not vote as desirable, 
assignment to the 11 not desirable" group means a refutation of the judgment of 
some (albeit a minority of) faculty members. Criteria of general visibility 
and consensus are imposed on the criterion of desirability. Those students 
on whom many agree may be the conservative, safe bets. The description which 
Frederiksen has constructed of Winston Churchill as a student (Frederikeen, 

195 *: ) would indicate that the promise of such a student would, at the least, 
te hotly controversial. For future studies, the implication is that a simple 
trait-by-trait description of students on the one hand, and relatively global 
identification of a general quality of desirability on the other* is not 
enough. The accuracy or uniformity of perception of trills is n v. sufficient!/ 
clear among faculty, even on those students who a great many ajree are i.igiJv 
-irable . 
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At this level, indeed, it may be reasonably suspected that many of those 
students who stand out do so because of some variable not tapped by this study, 

A visible and acceptable role in student government, a single, but public, 
acclaimed stand on some issue dear to faculty, a famous father, or the absence 
of obvious sin (together with good grades) may be at the root of a consensus 
of desirability. The absence of clear-cut trait patterns from the ratings 
would suggest that that level of analysis is not the one which explains the 
discrimination among students. One remedy would be to search out the factors 
that contribute to (l) visibility, and (2) desirability; another, and more 
sophisticated approach, might be to identify, faculty member by faculty member, 
who is desirable, what complex of traits is involved in this judgment (rather 
than simply all the things the student happens to be), and what actual 
characteristics of the student and the judge help explain the judgment and its 
basis. Finally, it is apparent that the problem is broader than that of the 
desirable student: it may be better to ask what is a desirable student 
population in the department (Fernandes, 1964) or in the college as a whole, 
or, what types (key combinations of traits) may produce environments of 
different sorts. Indeed, it is possible that some individuals with unattractive 
qualities may contribute in positive ways, for both faculty and students, to 
the department or campus milieu. 
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KDllCA'1 10NAL TKSTINU SIIIWK.K 
FORM FN-2 (1962) 



Student Nomination Form 



Your Name 



Rank 



Teaching Department 



No. Years ot Institution 



Today’s Date 



o 

a 



t 




On the inside page me listed the names of a sample of students from a current class 
at your institution vvho are being studied in a coo pern live project between the institution 
and the liducalionul Testing Service. The research is designed locapilalize ou insights of 
the teaching faculty concerning characteristics of desirable dudents which inny or may 
not be apparent in gl ides or test scores. Your assistance is a most important part of the 
larger research. 

The information requested will be regained as confidential and will be used for reseirch 
purposes only. 
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A2 

Infi'ructiont 

I. PIcam scan the following list of otmleitld ami place u chock mark hy the name 
of each student yon know or with whom you recall having hud any contact* 

Then answer the item al I lie ImKom of this pa^c mill llic i|ucslio?is on |hc facing 
pa^c. 



{Names of students in the sample to be rated are entered here) 




2. Please review those names you li ne i linked and place a second check mark hy 
(he names of student* win feel yon know* |iarl ietilm ly well. 
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3. Tin 1 slal 1 ‘HU'iils brlmv iiik fur uf various kinds, Note that tiominal ion 

cali'gorir* generally liiconu' \v*t* r\rltt*isr as one Minus down t!ii; page. In making 
these* iioiniiuiliniis* please u*e only the slii'lrnls uaimil on tin* facing page whom 
you fell jmi knun will enough In nominate lor llu* ilUtiiulkiii or statement of 
promise given. You may nominal!*, in each inslaure, as many of flic students 
iiuiiii'iJ as 3 on like, or you iiiit) make ni* mmimalions. hxi may nominate a given 
student mote llian mire. Nomina linns Jiiay he inimUil liy name or l>> the student 
numher on I lit; preceding page. 



a. Of those named an the preceding page, these students seem I kely ta attoin important positions 
af leadership and to make substantial contributions ta society after college: 



b. While nat necessarily likel y ta o*tain fame as important leaders af society, these students seem 
ta epilomize the highest ideals af the institution in scholarship, academic achievement, citizen- 
ship, and personal growth: . 



These students seem particu'ariy suited far graduate study in rheii field af interest 



d, These students, while possibly not achieving at the highest levels in absolute terms, have exh S* 
ited a laudatory amount af intcffri'lnaf growth from tho college experience: _ 



e, These students, while possibly not achieving at the highest levels in absolute terms, have demon- 
strated o laudatory amount af personal and social growth from the college experience: 



f. These students from the fs t on page 2 are persons I know' ihat hove not been nominated above, 
yet are persons I f r el that represent well some qualities and characteristics which make them 
desirable students for this institution; _ 



Appendix B 

Sample Data from the Student Domination Korin 
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Appendix C 



Analyses of the Factor Scores from the Student 
Rating Form 
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T i, , i . - •. cl;!:'- iir.l -.u ; u nr - ; i r ' ; r i , ' \ in In i r uppcirl 

are 3 ivj.L'i od b i i rj 3 ■. >.\ ■.; i ub ! J i t , of Leo fn N or ticuivr; (u-.o 1 1 ■ i1j.1 ^ 3.0, p. NY ) . 

Never i no let.* r , for those intones led 3 n knowing where hi.gn risk speculations !;*•• lv 
. lea i, the results of the several analyses with the factor scores are presence! 
here with Interpretative comments. 

'J he 3.8 factors have been described in some detail in a previous report (Davis, 
3 1 -oh : ) : ■'.!.? precede]* -r f<*r «- >bi a f ring I he factor scores conduct :t n/ the analyses 
have beer outlined on pawn; ; of 1 he nrcront report. For aid In interpret! ng 
the tables, however, the following faci ore are represented: uependabilit, (NNP); 

i n t e 1 leo tua 1 ab i 1 i ty ( I A ) ; con f ormi t.v ( CNF ) ; i nt el le c tu al value s ( IV) ; e t hi cal i t.v 
(ETH); motivation (MOT); likeableness (LIK); extraversion (EXT); self-sufficiency/ 
'■reat.Lvi.ty (SSC)j open-mi nuedners ( CM ) ; ulfru'u.m (AbT); materl ty (MAT); popularity 
(} ip); freedom from anxiety (AMX); grade perform- m :■* (Gib.'); tested scholastic 
aptitude (SA); ceJ f- insight (ill); and freedom from status- cent erednesr. (SVJ). it 
shoulu be noted 1 bat the /rude performance and tested scholastic aptitude factors 
are drawn principally from actual grades am) test scores, rather than from the 
ratings of the student on the 80 traits. 

Tables C3 and C2 present the significant F ratios for the various tests made. 
Tables C3 through C7 present the directions of the differences for the instances 
of significance shown in Table C2, with the serial numbers assigned to the 
classification column in Table C2 repeated as appropriate for identification of 

the same classifications in Tables C3 through C7 • 

< 

Factor scores against. Nomination F orn categor ies . Tab 1 e Cl su nna r i z e s the 
resulls of the analyses of variance concerned with testing for relationship 
between the l8 factor c:ores vs. frequency of nomination to each of He six 
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desirability categories of the ruination Form (for definition of these categories, 
see p . 2) . 

'Though these analyses are, as noted, limited by the lov reliabilities of 
the factor scores, several findings are of seme interest. First (see particu- 
larly the data fer the combined gro p), nomination to the most selective 
categories (the first three) does appear to be related to the grades factors, 
tc the scholastic ability (TA and SA) factors, and to the motivation factor. 

Ihe results are most consistent and logical for the graduate study category 
(category 3)? vhere ratings identify those nominated as more dependable, able, 
interested in ideas, and motivated, as veil as higher on the factors formed 
principally by grades and tested ability (SA). It vould seem generally that the 
graduate study nominations are more clear-cut, more explicable. This finding is 
certainly reasonatle, considering the probable values of the raters. 

In the bottom three categories of desirability-intellectual grovth, 
personal grovth, and the ’’other 1 ’ desirability category--! be results for the groups 
separately and combined seam to indicate that these categories (particularly the 
personal grovth category, category 4) tend to be a dumping ground for nice 
fellovs for vhor. some of the positive things said about those nominated to higher 
categories cannot be said. The factor score directions are reversed in many 
instances from their directions for higher categories. Those cited for intellectual 
grovth stand higher on intellectual values and grades while those cited for 
personal grovth stand higher on ethical ity, extraversion, altruism, and popularity, 
tut lover on ability ar.d freedom from status-centeredness. Such findings tend 
to support the specific validity of the ratings. It should be noted that the 
last category is exclusive, as it could contain only persons considered desirable 
tut vho do r.ot fit previous categories; in the combined group, these students 
tended to te rated lover on dependability and conformity but higher on ethicality. 



Those areas found previously (Davis, l 1 . ‘6ho; Davis, l v j6^d) to te related tc 
der L rati ill iv separate and apart from achievement- -li keabler.ess, ethicality, 
open -mindedness, altruism, and freedom from statu s-cente redness- -generally 
vash out vben placed against the first four Nomination Form criteria. Although 
there are occasional groups whose scores appear significant, there seem to be 
no logical patterns of or explanations for the scores when considered factor 
by factor* except for the grades and abilit;. factors, where the principal 
loadings are actual grades and test scorer- rather than trait ratings. 

Ferhaps the absence of consistent patterns in the other areas, although 
this may reflect differences among institutions, is a function of the low 
inter-rater agreement. For Stanford, the nominations data are sparse, and the 
criterion groups themselves could be at fault. The most striking feature of 
the data, however, is the absence of clear confirmation of the previous findings 
(obtained when the criterion of desirability was the judgment of the rater him- 
self rather than the consensus of his colleagues). Beyond the clearly cognitive 
elements noted in the previous and in the present analyses in the body of this 
report, no clear and consistent patterns of desirable traits emerge. Components 
of desirability beyond those of ability and performance appear elusive. It is 
likely that this is a function of the very lov reliability of the factor scores 
drawn from the Rating Form, but it cannot safely be argued that the hypothesized 
relationships would emerge had the factor scores been 2'eliable. 

Factor scores against institutional groups . With regal'd to differences 
among institutional groups (Tables C2 and C3), it would appear, first, that on 
10 of the 18 factors there are differences a* eng the institutions. Some of 
the differences are readily interpretable: for example, the engineering 

groups (and Amherst, where the freshman group no doubt contributes) are 
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generally rated lover on intellectual values; cr the scholastic aptitude (SA) 
ccores, neavi ly weighted with actual SAT scores, fo 1 lev: the diffe rences in 
institutional u-ear.s. Why Caltech faculty should rate their students high 
on se 1 f - ru f fie \ ency/eres.tivi ty and HIT faculty rate their students lov on 
the same trait, of v:hy FPI faculty give their students lov ratings on motiva- 
tic n, open-mindedness, maturity, popularity, and self -insight , is not clear. 
Students may he have differently, or faculty nay hold cherished prejudices, 

&r>i interpretation of these differences vould in most cases seen to be best 
drevu ir. a framevork of intimate knov ledge of the insti tutiens, if indeed 
t he d : f e re u c e s a re re al . 

The differences tetveen the Amherst freshmen vs. the upper-class groups 
seem mere readily understandable. The faculty rate freshmen lower on Intel Lee 
tjsi srility ar.d values, ethicality, maturity ► and grades, though the tested 
z c no i a s : i c apt i t ode fa c tor ( 3A) places thi s group qu i te high . 

V 3 z i ■ : z : o re c agains t student major . Tne differences among students 
g p t ' d by urea of major (7 able Ct ) are most interesting, where on half of 
ti.e 18 factors the moans foi' the groups differ. The professional fields 
group-, trough, generalizations trust be limited by the trail numbers, are rated 
hirhe.'t nr. conformity and grades, and lowest on intellectual values, freedom 
from anxiety or status- centeredness, and (actual) scholastic ability. 

Fr.gir.eer5 ng o;;d the natural sciences groups are pretty much alike, vith 
notable difiYu cnees iron students in other areas in their superiority in 
scholastic ability ai.d freedom from anxiety, and thei r lover standings on 
i Jtunl val_.es and self-insi ght ; engineers appeal more ccr.ee no: d vith 

: ersr-rvO states than do natural science majors. Humanities majors are rated 
high or. intellectual, values. Social s%. ' once majors fal« cLcse to the all 
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students means except on intellectual ability (higher) and (actual) scholastic 
aptitude (lover). The several juxtapositions of the intellectual ability vs. 
the scholastic aptitude may result from different standards among the groups 
which are unrelated to actual or absolute ability levels: e.g., the natural 

science majors are judged against more rigorous standards. 

Factor scores again st I-jyers -Briggs Type Indicator classifications . When 
the 16 MBTI types are considered separately (Table C5) differences appear on 
five of the 18 scales. For tne motivation factor, a combination of intro- 
version and intuition seems to be most favorable, with introversion the more 
important element. High ratings are assigned to 3 IE-- types, IIJF'P, INTJ and 
INFJ, and to 2 IS-- types, IS IP and ISFJ, and low ratings to 2 E-F- types, 

ESFP and ENFJ. The types viewed as most open-minded are 3 --FJ types, ENFJ, 

INFJ and ESFJ (whose extraversion of feeling makes them all value surface 
harmony), and EiJFP (whose quick perception of the views of others is easily 
mistaken for agreement). E5-P types are seen as least open-minded. Concerns 
for personal status are felt to nark the E-TP groups particularly, but not 
the ISFP or the IIIT- groups. 

Of more interest are the differences in grades, scholastic ability, or 
grades vs. scholastic ability. The high achievers are the I.TJ groups and 
the ENTF’s, the low achievers include all combinations involving S with P, 
the E-TJ groups, and the ENFP’s. On scholastic aptitude, the well-known 
distinction between the IJ's (high) and the S’s (low) appears. However, if the 
difference in the standard score levels on the grades vs. the scholastic 
aptitude may be taken as a rough index of over- or underachievement, the F3TJ’s, 
F yj's, FSFP’s, and ISTJ’s in this sample ovei achieve, while the Eh'TJ’s, 

Iini's, and HTTP’s underachieve. Ihe ESFP’s and ESTJ c come off better on this 
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basis than in Myers' {196?., p. 47) analysis of a larger sample on grades and 
SAT alone without ratings, and the 3NTJ' s come off worse. 

For the four basic types separately, the introverts are rated higher on 
motivation, grades, scholastic ability, and freedom from status -centeredness. 
The intuitives are higher on intellectual values as well as (as expected) on 
scholastic ability, but are less conforming or popular than the sensing 
types. The feeling types are rated as more open-minded, though less "extro- 
verted” in the meaning of the rating scale factor, which in this context may 
simply mean less forceful. Percept i ’es are rated, amazingly, less open-minded 
cr altruistic than judging types, but more able. Open-mindedness vould seem 
a reasonable component of the perception preference as defined by Myers. 

This contrary result, significant at the .01 level, may mean that those who 
focus on adding and incorporating new experience, rather than in coming to 
conclusions, in a situation where the instructor is attempting to lead students 
to certain judgments, are viewed as rigid in their failure to accept these 
promulgated points of view. This point needs further, careful investigation. 
The development of the judging function is indeed an important goal of higher 
education, but open-mindedness is also \alued. Tf this appears to be only a 
desire for students to be "open" to the instructors' views and not to 
extraneous stimuli, there might be utility in soul- searching. 

Factor scores against faculty characteristics . Only three scales produce 
different levels for the classification of faculty by rank (Table C6). In- 
structors and professors see students as less conforming than do the two 
middle groups. The major differences in level of ratings of open-mindedness 
and self- insight seem to come from the nondescript "other" group, a collection 
of graduate teaching assistants, administrators, and others, and are thus 
difficult to interpret. 
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Half of the l8 scales are related to the teaching field of the rater 
(Table Co). These differences nay indeed he as much a function of student 
rated as of ihe faculty member, for by and .large instructors rated students 
in their courses. Nevertheless, it is interesting to note the extreme levels 
in the nonacademic group, who produced the highest means on intellectual 
values, extraversion, altruism, maturity, and self -insight, but lowest on 
freedom from status-centeredness, grades, and scholastic ability. Engineers 
and natural scientists tend, in contrast to social scientists, to take a 
harsher view of their students' ability (intellectual ability vs. scholastic 
aptitude) . 

Factor scores against ex te nt and kind o f rater-rates contact . Of the 
18 factors, three appear quite frequently to be related to type of contact 
between faculty member and student. (Tables Cc. and C7); these are intellectual 
values, self-sufficiency /creativity, and altruism. Students high on intel- 
lectual values must he well known, preferably through conference or advisory 
session or through observation in the dormitory or on the campus. Students 
high on self -sufficiency/ creativity must, also be known veil or extensively in 
contact othi y than through class, advisory, or academic consultation. Per- 
ception of t; c student as altruistic is also enhanced by contact; absence cf 
current- contact depresses ratings, and knowing in the social context cf ihe 
c amp; 1 s er h an o e s ratings . 

The large nunbei of differences vhi cb appear as a function of degree or 
type of rater contact with students undei scores the importance of this variable. 
In some canes experience or contact appears to lower the level oi rating (e.g., 
motivation, open-mindedness, popularity, and freedom from status-centeredness); 
in other cases, knowledge of or contact with the student raises his rating. 
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(e.g., confonnity, intellectual values, extraversion, self-sufficiency/ 
creativity, altruist, self-insight). In some cases, familiarity may breed 
contempt; in others, time or contact app^.rs an important element in permitting 
higher ratings. This may suggest qualities which prompt limited vs. continued 
acquaintance, of course, but the qualities seem more likely to represent the 
assumptions an instructor v:ould be prompted to make upon casual vs. extended 
contact . 

Other data here would suggest that the context in which an instructor 
sees or knows a student is important. This is consistent with findings else- 
where (i.e., Wherry, 1952). For example, students known through extracurricular 
activities (Classification 15, Table C? ) are rated much higher than those r.ot 
known in this context on conformity , extraversion, self- suffi ciency /creativity , 
altruissm, and self-insight . Those known through academic consultation are 
viewed quite high on grades and self -in sight, but quite low on self-sufficiency/ 
creativity arid freedom from anxiety. Certainly the reasons behind student or 
faculty member assuming the initiative for making a particular kind of contact 
are indicative of the situation and may be outlined by tnese differences; yet, 
the fact of particular kind of contact may bias the faculty member. 

The fact that the nature or extent of contact affects level of ratings is 
not particularly dan aging to validity of ratings; each student has a chance to 
experience a variety of kinds of contact, and those he "'chooses 11 may indeed 
belie nls underlying traits. On the other hand, since one nay expect consid- 
erable variability among faculty members in tne nature or extent of contact, 
the limited inter-mter agreement, seems mcne plausible. 
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Factor Score Means 



3 

$ 

£ 

4) 

§ 



CVI CJ -4 i/NVjpcO'O'O Np On 0 

c\j o\ co ■-< q n ro m i> -4 w» 

l-n .4 -4 w*. ?n -4 _* -4 .4 Ax -4 



N VO Of W C> 4 I**, M <0-4 0 Cv Q 

c\j 0\ o 05 •-& »r\ m cr 0 \ 0 4 o\ -4 

irtntA 4 ^ 4 f' , i 4 4 u' 4 in 



H *A O A. H C> O H ON O On 

r— 1 — oj h- h -4 on o h vo p un 

-4 4 UN J- UN As -4 iA IT. 4 <A -4 



00 <T> UN ir> VO 

H CN H H -4 

uN _4 A l/> 4 



& s 



^ f- 4 t- w <*■> o fc- up un »<n C \ 

Os O O Q VP UN Q ON On ,-t f- ox 

^#--\uNjSj.^fJ\-4 4 A 4 -4 



-i0f0<5t-0\0\0 -4 (V Os 

jV^fOOvoOOXQOJ H Ox CO 

,4 i/> A 4 UN A A UN -4 



o o c\j u*\ v d o 3 

r- -rs f- c\ ? on poo 

t UN -4 _# 4 -4 J\ -4 



OnOCOCO Os t W H CO On 

<T>OjC'UQHr»QQ df-WN 

.4 A A lA A 4 uN UN A 4 4 



f- & S Q Sv H 5 S O S S 8 n 

.4 is 4 wS 4- UN >,> _4 k/N .* 4 -4-4 



PjHC'f~OJONCNO -H O v£> fO -0 

- ~~ ~ OnOUN On iA 

-4 JS -4 -4 -4 



H ON 4 

SS5 






S S S’ 5 :? S S a 0^3 £3 

c j -4 H I s - -< «H ® -4 



c s 

l +> 

§ « 

■? o 



? 3 

e f 



V »’ 1* e v v v 

3 I I I ! I 3 



& 

-4 

UN 

& 

* 

a 



& 

& 



1 

On 



o 

ERIC 



62 



TOTAL GROUP 



o 

ERIC 






II 



I 



^ U> 



H Cl> H 4?- VO V/l 

H rg v/i co v/i ( 7 \ 



fr \J) *r .tr fr fr 

a p « « ® ^ 



o 

3 

| 

p- 



S £ ^ 5 

VC V/l H V/l 



* 



> 

3 



£T V? *" £1 v/ 

op o as & vo 

so fO Jr \0 ro o 



£" ■£" V/l V/l £"£" 

* £ G P 3 * 



O !f 

I 

& 

i« J 



I 

)f 






\n \n vn v/l *r 

6 OV 6 H -4 

H Os O OD 



v/i f O V 4 “ v/i 

O U> K v/i C. TO 

CO */l CD v/i UO 4 ^ 



v/s v/i V? 4 “ V/i f- 

O H O VD to VD 

w (t\ w ft o C 






4 ^ £' V/i *-■£- 

VO Os H SO vp 

UI CD V£) OD UI 



m: 

H- 

r& 

M 

P 

W 

H- 

9 

H- 

H 



63 



Factor Score M-ans for Students Grouped by J^'ers-Eriggs Typo Indicator Classification! 
WRrro Analvees of Variance Yield Significant F Ratios 
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